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[»**2] wiEasiBai-?— *3&<: <*j«**i4WE:a: 

^•£ e 

[»3R*5] »ES«A<, &Ta>*-f 3f<D#BBfi|fiL o 
~? << v9 •« o 

[R#*7] ?i<rE$^IBitfflT— ttfiSStt-SttEX 

•<DME*X*^<0ift#S«*4, IS^H3cd^^^;u 

W*91 0] MEIKIBfET--***. f*ja*3K4«lE 

*»*£dt\ Ii*if 2 07 r v£;l^^:?.< ^^**o 
[«*91 2] SirE«Aa>aS«*rt<. DftEBtSiaS 

»ei*5I0>i*js. *fci*. frfEfflA(c<t ysBttfft 

•St*— *jWrS#<bS*L4. nW\0)TV*JW s ?y 



7] miEBisiBWx-*. &&tfmtmx<D 

•St*— **<*^-»*Mb**iTi3y. WEKtttt^U 

**»s. 

oT : IfrfEIi3fc3gl <^fy^;^7 7^'^i« ; IfrfE 
flSSKDBSB-x— *<r>tz$><I>XjimW: ; «TE«S-r— £ O 

v$;U^7>r ^•£i>X7 i A e 

^7 7-f -^S«£4jSt«sat?fcot : WE*»<D 

*"rvZf ; WESSj&^SSt*— £X HJ — A££fi£-T 

lirEXMftT*— £X h 'J — A £ fJfEWS 7*— £ X HJ 
—A 4k*. T^£;u^:7>r ^^»*^#*tJ-*Xt-^ 
^ ; £4Hx./=75fto 
[»*a2 2] Mir, 

wia«A3&^t>y ^7^— £ ^^f'^; jci^^f- 

$X h'J-AS4)JtMf7? ; WlEXmKtt-r— ^ 
XHJ— A. JSE***^— ^X MJ — A. fccfclXW 
ESStt— £X h 'J— AS, 37< vOm^ 

^7 7<^^f45t±fiit*i*ai?*ot : «rEA*= 

nxf^v^; BiIfE^A<DW«S^4X7 1 ^^ ; mTfEB 
M^&XSBMx— *X h'J-A$Mnxf 
ffiTlE^^t)^:#B^ix— ^X h'J-AS4j$tl,xf 
; TOE«*36^»*-t— *X h'J— A*^fi3c-r-S>X 

IrTfE^gB^^-^X K'J— A. BffiXH«f->X 
h 'J — A, JS«fcl/TOK«S-r— *X KU— AS. xv^ 

fb7?;* 0 
[»»*2 4] MIC. 

idEix^by^f- ^s^#4x•7 l ^^ ; xgy^^— 

fflfE^SB^fflx-^x h'J— A. TOEXMIKix— *x 
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" J [0 0 0 1 ] - 

^^U 1 ? L^y hvXfAj T?fc4 1 9 9 8^4fl 
1 4Hffl||<D*IH#»fiaili»6 0/0 8 1 f 7 4 8^ 
^iffl^l 1 9ft (e) (C*rJ*«$Mt£»-r 

4o r/<-ft;i/OL/'v K~>x 

^fAj T?fc* 1 9 9 8$1 1 1 2Sdjll0>*B1#Stoii 
Sli09/1 9 0. 9 9 JSWO)45»A< rtn«/{ 

x*fo& 1998^1 1^1 2 a&mo*mtt 

JtUIBftO 9/1 9 0. 7 2 7^-<t£. *B1*»a 1 2 
O ftl=*r5*«**±iK- -5 . 
[0 O 0 2] 

X«M*4»*«#iii«#<tS;lu ®A 

fc=*-^5/x? KOnetged object) O CiWfll* 

[0 0 0 3] rfcSBWtOT^yu^^-f '^l^vXf 
AldU hfc^W'y h7-^yXf A±1? 

©IX5l«*tofc«T-«5|-tf*fiJ(C3pJfflS*i4Tffc5 3o 

>*>^*5J:tf/<— fWU'> h (virtual wallets) 

[0 0 0 4] *3£BJ[£3:*:. ftfg SS«-T*(D(=¥lJffl* 
*i 4 d t b < if * 4 v £ V 5 7 -f ^ 0 EP ■ ( c m T 4 o 
[O 0 0 5] 

[*«©«*] HSKtS (physical wor ld)(= jsl^T. * 
U *(DJ:5&*31M**©iEattl*aiE'r'&<D3&«HBt 

[0 0 0 6] WfiBWlC -rv*;U4t*(digital world) 
fflt^TSBTftft^ttJt (non-repudiation) £tr-/K— 

S&SfcSI (electronic financial transaction) (7>t£J^ 

[0007] »-<dhhi*. ft/as*,*^^*^:* 



^^fc^S^5llc^LiB*DOS^/i£^Ii^4=i>i> 
4C4(C#4 0 *<<D*fi\ □>va-7li||jtf$j#o 

n*5*<* x*ay*<z>«5ie«iLrLxtttx 0 saiico^ 
[0008] a*4t*-oaaia5L-5iaH4 3^ * 

[0 0 0 9] ±IB. a3«fctf*Offt<Z>BBHI*. **M0)v 
XT-AlcJ:yjW**ix*o 
[0 0 10] 

^€^B*at?^4i>x^x,^titt-r444 tic. 
[0 0 1 1 ] *«MI=«fcy. fy^;^7-f (-x 

*>y^?4vQ) §«->xfAit, f*a**i*jt»icBB 

*LS^7^^S4t?. ^S<7>S$ffl4fiA(D^«li. 
[0 0 12] fy«7^ ->^**(=«^at;C4*<^ 
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[0 0 13] X»*ttfltr Seizor* 

j&ja-rssM-cfT-^x n=s< **iSo l^l. s» 

[0 0 14] 1$S(DBt5llc»U TWyy* vim** 
[0 0 1 5] Jzi£<Dcfc5(c. X»(&JMfllli!E(:: % i@A0> 

[0016] «A©**a>aaii. «a<z>»*©^:7 

2I4. «9lN»3(i' bl« SX+ 1 >t I) C t C J: 9t 

^£fif3W(4. «A<D**^:7< ^14. ftisnx* 

[0 0 17] f^;Kf7 7-f ^^S«*ftja-T4(= 
(4. X»©BMffl7*— *«A»*t— **flf#-f *» 
^□-bx(4. tt*co«*i«^bafB*fiJffl-r*iaS-iry h 

[0 0 18] tt*<Z>^BB*~ «**attfB*« 

ffllt. 3t*Sf*J«-rSfflAa>»ffi*— -eXMJij-r— 

[0 0 19] flA3E»<A*-r«^^ • ^f*X h^r— £14. 
«A/£(t*<»*»#4~ "CBi^bS+tftctt-e** 



5o JSlTI=KM**t4<fc3(=. d*U4. X»A<«at*3K 
Tl^tt^itx3Ba*«tE*«Alca«L. W5l*Sl* 

[0020] Xf(^i$$lf-^i:iiAa)i«f 
— #J*f4\ »*<b£f«fflCT«#L-ct,<fc 
l\ ^(M&ffixit. ^f-^h'J-Aii, Willi* m 
iRGB (u^h\ ^y— :?;u— ) ^-ft-^tc: 

ffl-T*C4t3&<T?**. iK.ll CMYK (y7> . "7 
£X h'J-A(i^t^,v7>, V-bf>^\ -fxp— . 

[00 2 1] fv$i^7 7-f ^/^»*(4. r*5— * 

>h<t. fit. t L-CffiB**lTtckl^. fBttffi* 

14. 2*7C»*««(=j3(+*. X. Yli; r. dffifl 
^ ; */=I4 3*5c»*««I=j3lta. X. Y. Zffiflg 

[0 0 2 2] tO«B(c(±. <IA<D¥£ ^—$14. m-±i^ 

— fl)©ya**Lfcx kp— <7£^a,xi^x&i* 0 &&zf 
a-t^tpiz. tomtit— mt. n^it^Htzm^^-Ts 

K (cryptotext) «lcJE»$;hS 0 Tff-f > htt**. 

Xh»J-Af-^i^ .</\V hftfit) (&*4. 
[SM-xO^ (bidirectional padding) Jiffi^/ifi, 

[0 0 2 4] *,L. m^^—5tf. Kft^fclijt^-r— 

^ ©i^*i3&^ j: y *tt*iii. -3)\,—n*LTSv y — 
K«*<. •*©ay(D7 r — *{c«ffl*+t*ztA<t?s 

[0 0 2 5] ^fc^tf/Sfcrty^Ex — 

«T-^<fcygLMi^. -tfP;K>r> hfflA<*5— *>f> 

(4. s*^— *<oy^^-f -v^aatMttSsix-si^w* 

[002 6] ieitLt±i:4fy^^*77^^S 
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->£ ^u-(D7K>r > httftJEOXWcft*©^— * (z 

[0027] a»atB»»-ea*ic*Ra-r-6*(ci*a« 

[0 0 2 8] fy^7^7^f€(i, gijx.ll *. g 
i f ^T-OU; *. t i f f ^7-f7U; *. p i 
ct ^T'OU; *. jpg ? 7 -<-/U3S £ y 

7-f;i/tL"CRSJti, KSiflKDT— >7t-Tjh:H1 
©»&Lfca>ei- £ yy Y-^^7-fu7=5Mz& 

[0 0 2 9] got, — BS"CI*. *ftmo>Tis*JU? 

[0 0 3 0] {&<Dmm-eit. &§£BWrzs$ JlsV'yy <( 

I=«^-C*4«A<7>«*© 
aKM(=E*DpTttftvjU^*^— Vyy<( vVWSLtt 

[0 0 3 1 ] **W(=«fc*Ll*. "r^Zfrf^y 4 vim 

trx^ — £ — -f^X^U^ ; >^E'J ; ^fA ; ^~ 

^ h ; X^r-V*" ; ^'J ; fc«fcl//*fcli*(Df6Htt 

> h£tt*.Tlvtt<fc^. 3>tfa- */\— h^l7 
I** &yy<( v^Z^Uy h ; B^'O ; £ 'J 
— > ; V^X ; ^^/"H— ;u ; ya^fXf-f ; B 

(Ra : mi=Hi:fE»&y) ; posi^>8 

B* £/cl*11A<7>W«£ r/<^hP-^j iLTfl»y 
*LtH-OA*ftB, *fcl**— tK— K(DJ:5«:f6<DA 



7— $ 7 r -f ;u £ fi A3b<ftfiR-c? # £ <fc 5 let" -& OOSi 

[0 0 3 2] *«W(0vXfA"eaaO3>ea-* V 

mv>. iiiov^h^x7*. «A3b<a5ii=H-r 

[0033] **Ufli*. flA3&<ffffi-r«S:»(c» 

(Di*S»5Xf7^; KftA^X^W&^r— h'J 
-ASMt^Xf^^ ; **^&S*-7— $X h 'J — 

[0 0 3 4] -tO^SIi. Ml- : aAA^y^f- 

t-^^ ; te&xfxmmiftT—Zy. h'J — At. 
[0035] ft*SU6^JBJ=*5^r. **Wf*. mxtf 

— *XMJ— At. Xfl^f-^Xh'J-Ai:, ^€ 
x— h'J— fy^M7^<7^1«^ 

[0 0 3 6] CG>*afel±. MIC : iX^b>^f-^ $ 

[0 0 3 7] f-^MJ-All U±lZ±vmBAL. 
tJiL^o *D^T, ^— *X h'J— AI*lB^b$*lT*«fc 
[0 0 3 8] ISSfli-C, *^B^{*. fljxli. 

4 2a»t©j:3tt, 2^^%r B io^fe^injt-r4*;± 
t^lft^tiffi-r^o cc-e rfy>M77 
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[0 0 3 9] *IBHffl»t?a»-r*J:5(=. *fB^0fy 
Lr^* 0 **l£I4* =i ^a^v* 

# z> =i tf — $ *i fc CD Tf 1 4 & L \ t L v 5 ffi m £ IS A * & 0 

[0 0 4 0] **m<d»* % vxfA, *5«fct;*ar4. 

*3M>si±**:tf>. cfcya*L^-ea553o cih^(4. 

?£T*. ■7 f v?^ju»*(Oi&|jir(4*tit:-efc4o 
[0 04 1 ] *«H«B»iCf*B-rSJ:3(=. fcJMJKD-x^ 
^yuy^^-r ^^»*(4. Xff;«7< (steganog 
raphy) (ra«-r*a«**Jffl Lt, ■ 

[0 0 4 2] ^77< ^WCffSL, »*fl:S;|xTl* 

£ y ^ -b— v*<fc£ fc i\ 5 ^H^Ri^rc <b (4fi8«ici4!& 

-rT?&S£l4»5>£l^. t^ot, f^77<*;^i« 
(4 2 #JU±0>a»#IH(DiB«©rt8S|li* 5 t I4K^T 

& 0 *(DBMI4»*#<7)eiI<Dfc&^fcy. -^LT^S 

W<D»fflKHrt(C**;h*::£l4. f^tt^ 0 * 
*M<058Jfi^ffl<D«jS(4. - 5-<f*BS#ft*<^H-e(43St^ 

[0 0 4 3] fv^^77<^ TEpgj <tUN5fflI§ 
U ccDSifcl*. #0)1ft*Tf(4il%l=«*i*y. IftlBL 



b*liOSI»CCtlj:'C!SS^ofca)1ffcS 8 *SBSfll:: 

««a«a>»^bta«a>fc»izRG 

[0 0 4 4] *3£f!fia>Tis$Jl,<f^-P4 vVffit&lt* *S 

* w <d*&x mm *ii4citf-c#4, 

[0 0 4 5] *^<Df v ^ 7 7 < 7 ^ , 

t\ *^B*5l^*?i](cfi]JBS;hTiJ:l\ l ^JSWcDtv 

K^fAj £f£ 1 9 9 8*1 1A12 
Btt«<D*B»S*tti«*0 9/1 9 0, 99 3f;SW 
<7>€ffr£ rM;^+>^j fT-S 1 9 9 8*1 1 £ 1 
2Hffl«<D#H»»aiHW0 9/1 9 0. 7 2 7 -£§■ ; H 

4vXfAfccfc^J 4fTS 1 999*4^##Biti 

Bi©*HW»mii*o9/###. ###4§- ; ascfctf. 
*aeais*i»-r*->x^Afcj:tf*aj 1999 

*4^##BttJH(D«Ht$tt£tiRi»0 9/### > ## 

K=B85ILT*«l=fiJffl*tL-6ci:*<-c#-So ^^Lb 
#£ii«<©BB*l4. *M«»*(=5lfflLr»^at;o 
[0 0 4 6] ^^B^co^^^yu^'^ ^< 7^i=Svxf 

Afe<*:l/^;i<Dftj^I4. JSTFS^fco 
[0 0 4 7] «AI4. SB(D***a3ltM(=a*ai?# 

-So 

[0048] ftcDttwmmmmxi*. v^y^vtz^ 

ttfittMaSr^^^-r ^C:(4±<£:l> 0 »BBM(c. 
[0 0 4 9] Eft4«ji5l*^ **W(0fv*M77-f 
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vi-7i:«fctj ****ifcci:SiIwr4i:it(=. 6 

[oosol-Mr, «A(4. SbO)SS+-SMt 
r. s/£S*i=«#<b*;hfc*^£8it % c£# 

[005 1 ] *«W(0fy^;^7 37 -f ^ £ EPffi<DHffi 

[0 0 5 2] *JfeW(DMfcaBiffl£«jS«*. JSLT0>fB& 
*5 <fc 1/ 3I« Bt m & 08 t> ( c ft & v fe 5 5 o 
[005 3] 

[0 0 5 4] B1 14. *«WI=«fc-& % ®A TJohn Doej 
[0 0 5 5] fv«7^ ^^»*<om»3&*t6^J8 

i4. -hfr - zl— if— >r — ^x— x (gui 

1) S«$*L«*:*0>Btt 

2) ¥€£;h£:£§<7>:*:;££fcr4P*3 

3) 45M^77-f y^Cf «t*f K«« 

4) V^U^tDfBJ* 

(=»jrr*s*(D*K£^T?i*T*j;i*. rush** 

Sfc JBKT?fcy. KSiB(=*T?fi 

[0 0 5 6] -I3>ya- ^Jb<X»$«*K 



[0 0 5 7] hP 

[0 0 5 8] Sfch 2OC0>*vtr — vX h U — AI4* ^ 
^i*»*frst£tt/BLft*<b*3h£o B«ll±* ^e-r A0) 

— TrBt^b^tiTt £l^ 0 ^f^hlt =i >>zl— 
« * ftffl L TBt^b £ *l « C <t *><T? 

[0 0 5 9] 2 0(DHf#<b**LfcX h'J— AI4. 
tf, «*<Z>* Us/ h\ ^»J— ^U— (RGB) 

hy— aco^/nv m4. «(©ft*?y(cffl^6*L. 

^Xh'J-A©/W h«[(4. ^'J-V^^t-So 

[ooeo] y^^-r ^^.**i4. r^^-^v>hj 

fc<fct/^^-fi<b Lxsi^^o i*ya**u5-f >^ 
■ x kp— tit. mwtm-Ji^—v%iy&i£*iz> 0 » 

^■1b^p-trx4=(c. ^^-(i&ii. ^^b^ttfcBt^-T 1 ^ 
[0 0 6 1 ] (f7^-f*^f«X hP-^t, BJ^feJ: 

HfPfltA<^l/— t-Sf' J — ><D«P»lcffllx&*u. Di— tfP 

o*<y^^-f *-/^»«cfc yftittttf. -tfp^Whd 
4. ?x— xi4. (^s^D^^i^}*fcftL^x hp— 

[0 0 6 2] 3.— y 8 — »«<D$r^-f y^ssai*. T^v 

[0063] n >->zl— Ti4. ea<D***a«Mi=K 
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[0 0 6 4] =l>is3. — -?tf*m\Z$:Wlzm%LtzAT* 

*ft:S*L4o *d*t. B*tir*. X§i*j-e re^^-cfe^j 

(in the clear) Av *fcl*Bf #*b£*iT l^lvfc^O 
1) W£(4=i >v^-7|cd: U¥^$tLfcZ<t ({SJfflTjC 

^Di-(DA-cfe^) fir, 2) ^£*><. kikkd-sc: 

-e£& 0 . f6AC:j:y*#fl:S*L» 

[0 0 6 6] B2lt "T^^frV^^ 4 

Hii8«*-i0 46ttfflLt, imfo$6^<t3L>zs 
>i o 3fzj3Lx-cBB*^b**Lri^-5o ^n-fexr*. h 

1 0 8$«fflLt, nm^mt^>is^A 0 7(Cfc 



P— <7 (^J7- 



so 1 



BKSBSfc 

a : 



[0 0 7 1 ] H5I4. *<DB«*<IB4t::^*;h-CI/*4IS 
■r o (2)5|z^f cfc 5(c. ^S^^cli. WindowsRU@2 

1 4vftj$.$*i&xwoicw*$:<»7'*x ^mm2 i 2 



[0067] 2-0<»m^it£tltzX h U — AI4. _tj£<D 
ffiffl£*l6 0 12X\ BS^b**LfcK«?J/<-< hill 

$ ■ X hn-^at^l^o ^S^i: LT» 6*1-5 
^f-^x^ M4. mA<D%%t?zs$JUm%t<D%.— <D 
t^yi^ h i 1 4-^<Dflffi-$"£t?. 
[00 6 8] SI3I4. fy^77^^^i«$V7ny 

^^^t-ySU[iV7^x7-CM*ti, -rv^ 

-tr— vaiyi4. 7i>$jixw£mmt*$:tttizmm 

-f&XT^y (12 2) 0 :fl)Xf*;?i?, X* 

7>T ^ 77 KOxT^iciH. *fcl4A*r* (12 
4) 0 ^tx-c. X«r±* fy^77^^V7h^i7 
l=«fcy»**L. V7h«!?i7A<, X«»^X»#XS 
£j£-f& (12 6) e JtMfiO) Ted Smythe fflO>lf> 
:7;u*<H4C:3j*S*u X**3t<D-9->^;u(iia5(c^* 

*LTl^ 0 

[00 69] H 4 ic^-T «fc 5 fc. X«K » 2 o o 14. Wi 
ndowsRU@2 0 4T*^$tL^XS(C^-r-5»p$ffl2 0 
2$tt^ii<t?#, 111^14^^2 2 1 ( rKftj ) v 
2 2 2 ( r*Xj ) . 2 2 3 ( r»* j ) *^t: 0 
«j ^^OT(r. X«fi2 0 0lt «E3l(cBB-r**SI 

^*l&l=»56l***lttl* : 
[0 0 7 0] 

i oimi^Tft 

03/23/1 998 
3 5 2 8 6 4 

Radioshack 0 1—3516 
Ted Smythe 
Visa 

4321-2345-6789-3456 
0 4/9 9 
14 8 5 
0 2 3 5 9 8 

ffi™t&&i££m<D$zvttMmz&& 

Radioshack-e<D33H±lf *yA<£ 5 CT^l^f 
2 7. 5 1 

%^t;ztt><x£. U®i4^^2 2 1 ( rajKu ) % 2 

2 2 ( r*Xj ) . 22 3 ( r*«j ) 
X2 1 2(4. T*Xj 9 7?<DTtzmi7ji£*lX& &l^ 0 
[0 0 7 2] B3i:m#!Ht4t, X^lCgrSf^A 



14, (12 8) U X»*SL^a 

(13 0) 0 0 6(4. *=Etm%Z¥5?ji?&ZL 

[0 0 7 3] {3 6(c^-rcfc 5(C i«a-if->ry^- 
7i-^2 20lt WindowsR|BH2 2 4T?fMM"£c 
<h*<-e£\ ®®[4£ :?2 2 1 ( rsfftj ) . 2 2 2 

( r*xj ) . 223 ( r»*j ) &<g<b 0 r*«j $ 

^0>T(C. S*3.— tf— — 2 0(4. 

=eAJimm2 3 0. «fcl\, >^EA^lfi^2 3 

o(4. ttSiicii. tf— ic/*— v^uy^SA*^-* 

>f>^-7x-X2 2 0lt Hd. **>2 5 i ( ng 

*j ) . 252 ( r^iiE-r^j ) . 253 ( raurr 

&J ) £^A;T£<i:<. C*i£>(4 x 3.— +f— *<**L 

[0074] n.— if— (cd=yA**^fc^-f 

h*** «5«fei;XH»lt, :x— +f--^£^ < ^::fr41- 
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Digital Graphic Signature System 
Cross-reference Lo Related Applications; 

The present application claims priority under 3 5 USC 1 1 9(e) from US 
Provisional Patent Application No. 60/081,748 entitled "VIRTUAL WALLET 
5 SYSTEM" filed April 14, 1998, the disclosure of which is hereby incorporated herein 

by reference. The present application claims priority Tinder 35 USC 120 Jrom US 
patent application serial number 09/190,993 filed November 12, 1998, eatitled 
"Virtual Wallet System and US patent application serial number 09/1 90,727 filed 
November 12 1998, entitled "Information Banking. 

10 

Field of the Invention: 

The present invention relates to a digital graphic signature system for use in 
electronic commerce. The system comprises a document portion, including 
information relating to the document being executed, and a signature portion. The 
15 document portion and the signature portion may be encrypted and merged into a 

single object readily identifiable to an individual. The terminology "digital graphic 
signature 1 ' or "digi graphic signature'* is utilized herein to describe the merged object. 

The digital graphic signature system of the present invention may be 
advantageously utilized in electronic transactions, including transactions over the 
20 internet and network systems The digital graphic signature system of the present 

invention may also be advantageously utilized in conjunction with information 
banking and virtual wallets. 

The present invention also relates to a digital graphic signet that may be 
utilized to transmit a private communication. 
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Background: 

In the physical world sutures arc easily recognized, particularly by then 
owners. The authenticity of such physical signatures, however, may be difficult to 
verify. 



In contrast, in the digital world, digital signatures arc sufficiently verifiable to 
support non-repudiation, using modern puhlic key crytpgraphic techniques. Such 
digital signatures however may not be in a form recognizable to humans. Thus a 
need exists for a digital signature system that permits an individual to visually 
recogni** their own signature. In addition to this problem, there are several other 
problems thai need addressing in the electronic commerce and electronic financial 
transaction worlds. 

A first problem relates to provide information to a consumer regarding the 
substance of a digital document to be executed. This problem maybe phrased as 
iS How does a consumer know what he or she is signing when the "document" being 
presented U digital?". 

Att additional problem relates to a consumer associating their digital signature 
with a digital document. This problem may be phrased as "How does a consumer 
recognize his or her own digital signature that ha? been associated with a digital 
document?". 

For financial institutions, merchants, vendors and/or others ensaged in 
electronic and non-el ectronic commerce, problems arise when a consumer fails to 
remember they have executed a transaction. This situation may arise in part due to the 
length of time between the transaction and the consumer receiving a billing statement 
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that includes the transaction. Many customer service calls are received from 
consumers requesting additional documentation regard** specific transactions on 
their billing statements. Often the consumers have good intentions and literacy do not 
remember the transaction. Upon receipt of a document showing the nature of the 
transaction, and their signature, a consumer will generally be abU to remember the 
transaction, or recognize the transaction as fraudulent. This process, however, is 
costly for institutions as it involves maintaining a customer service infrastructures, 
including personnel, document processing and mailing capabilities. 

Problems and costs that exist today in the physical world are likely to become 
worse in the electronic transaction arena. A particular problem with many current 
technologies is that consumers are not provided with visuaL feedback of their signature 
executing a document or agreement. Also the data provided in billing for electronic 
transactions may not provide sufficient data for a consumer to recall a transaction. 

The mregoing problems, and others, are addressed by the systems of the 
present invention. 



Summary of the Invention: 



The present invention provides a system that allows individuals to recognize 
their signatures on electronic documents, and provides information relating to the 
document, that may enable the individual to understand the document being signed 
and recall their execution of the document at a later date. 

According to the present invention, a digital graphic (digigraphic) signature 
system comprises a graphic formed by combining details relating to the document 
being executed, and an individual's signature. The document details and the 
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iadividual's signature may be encrypted utilizing conventional techniques to provide 
enhanced security. The digital graphic signature may be displayed through a user 

interface for inspection, 



Document details that may be incorporated ioto the digigraphic signature 
include: 

an abstract of the document being executed; 

the body of the document being execiaed; 

excerpts from the body of the document being executed; or 

aa individual's notes relating to the document being executed. 



In general, it is believed advantageous /or many purposes to include at least an 
abstract comprising a digest of what an individual is actually agreeing to by executing 
the document The abstract may also include reference information, including but not 
limited to, the date, the parties involved, transaction reference numbers and the like. 



Preferably, the abstract is written in plain (non-legal) terms that are readily 
1 5 understandable to even relati vely unsophisticated consumers. Generally, the abstract 

will be reduced to text forpurposes of forming the digigraphic signature. However, 
foT certain applications it may be advantageous for the abstract to include graphic or 
pictorial information. 

For certain transactions, it may be advantageous to include the body of the 
20 document being executed, or excerpts from the body of the document being executed, 

in the digigraphic signature in addition to, or in place of an abstract. The document 
body, and/or excerpts will generally be reduced to text for purposes of forming the 
digigraphic signature. However, for certain applications it may be advantageous to 
include graphic or pictorial information. 
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As set forth above, document details may further comprise an personal memo 
area that allows an individual to record information of their own choosing about the 
document being executed. Preferably, the individual will enter information that will 
help them remember the transaction in the future. Such information could include, the 
purpose of the transaction, the nature of the transaction, as well as other details having 
significance to the individual. 



A representation of an individual's signature may comprise graphical data ' 
generated from a graphic of the individual signature. An Individual's signature 
graphic may be obtained by capturing the pen strokes utilized by an individual to sign 
their name, for example through the use of a graphics. tablet. 



An individual's 



signature graphic may also be obtained by scanning a signature from a physical 
document In general, prior to the translation and merging steps described below, an 
individual's signature graphic will be similar to the individual's signature on a 
physical document 

To produce a digital graphic signature, the document details data and the 
individual's signature data are merged- The merging process may include encrypting 
both sets of data utilizing conventional electronic encryption techniques. Different 
portions of the document details may be encrypted with public or private keys. 

For example, it may be advantageous to encrypt document abstract data with a 
private key of the individual who is executing the document utilizing convention 
public key cryptographic techniques. The abstract could then be made accessible to 
the individual and the other parry to the transaction. 

The memo text data entered by an individual could be encrypted with a 
sjTTirnctric key known only to the individual. As explained below, this could provide 
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an addition insurance to the individual that the document is not forged and assist them 
in remembering the transaction. 

The document detail data and the individual's signature data may then be 
merged, for example utilizing color encoding. In this technique, each data stream is 
5 utilized as color values, for example in standard RGB (red, green, blue) color 

encoding. For example, each byte of an abstract stream may be used to generate blue 
values, each byte of a memo stream may be utilized to generate green values. A non- 
changing red value may be used to complete the description. Other color values may 
also be utilized. For example, CMYK (cyan, magenta, yellow, black) color encoding 
10 may be util ized to produce the digital graphic signature with the cyan, magenta, 

yellow and black color values corresponding to data streams . 

The digital graphic signature may be defined, as a series of ink strokes using 
"color-points", a point defined by relative coor«iinates with respect to a defined 
signature area, and a color value. The relative coordinates may comprise x,y 
15 coordinates; r,6 coordinates or the like in a two dimensional signature area; or x.y,z 

coordinates or the like in a three dimensional signature area etc. 

Initially, the individual's signature data may comprise captured strokes of a 
single color. During the merging process the initial color values are replaced with the 
encoded cryptotext values. The point positions may be retained to preserve the 
20 graphical appearance of the signature. 

Differences in the length (byte count) of the signature data and the abstract 
and/ox memo stream data may be handled by a bidirectional padding technique, or 
similar techniques understood to those of ordinary skill in the art. 
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If ihe signature data is longer than either of the abstract or memo data, zero 
values My be uscdfoi Ac blue and green portions and only the nor, zero, non 
changing red value used for the remainder of the signature data. Inthis way the 
graphical appearance of the signature is preserved, even when the abstract and/or 
5 memo data ends. 

If the abstract data and/or the memo data is longer than the sijmature data, zero 
point values may be assigned to color-points, while the color, arc used to encode the 
remainder of the messages. The remainder of the message need not assume the 
graphical representation of the signature data, but may appear as part of the digital 

30 graphic signature. 

The resulting digit*] graphic signature may advantage us] y retain a visual 
appearance simiJar to an mdividuaTs physical signature, however will comprise points 
. of red, green and blue color. The relative amounts of red, green and blue points will 
associate the digital graphic signature with a particular document, as the green and 
5 blue points will be generated in response to data specific to a particular document. 

As will be understood by those of ordinary skill in the art, different colors, or a 
different color encoding scheme, may be utilized in a similar fashion to produce a 
digital graphic signature according to the present invention. 

The digigmphic signature may be saved as a data file, for example a *.gif file; 
) *.tiff file; rpict file; *.jpg file; or the like, and associated and/or stored with data files 

for the transaction. Preferably, the digigraphic signature is saved in a file type capable 
Of being displayed on a video monitor by popular computer software programs, such 
as internet browser software, financial transaction software, and/or word processing 
software. 
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Thus, in one aspect, a digital graphic signature of the present invention 
comprises a graphical representation of an individual signature produced from a 
plurality of points, wherein the plurality of points comprise at least a first set of points 
corresponding to information particular to a document being executed, and a second 
set of points corresponding to the individual's signature. 

In another aspect, a digital graphic signature of the present invention 
comprises a visually recognizable multi-color graphical representation of an 
individual's signature capable of being displayed on a video monitor the graphical 
representation having a unique color scheme corresponding to the document being 
executed. As used herein the tenninology video monitor includes compuier video 
monitors, televisions and the like. 

According to the present invention, a digital graphic signature system 
comprises a digital graphic signature of the present invention and computer software 
and hardware capable of generating and displaying the digital graphic signature 
system. The computer hardware may comprise a central processing unit video 
monitor display; memory- modem; keyboard; mouse; trackpad; graphics tablet; 
scanner; printer and/or other generally available computer hardware components. It is 
generally preferred that the computer hardware include a graphics tablet; electronic, 
pen; touch sensitive screen; mouse; trackball; joy stick; elecxronic pen; point-of-sale 
electronic pen apparatus or sinular input device for capturing an individual's signature 
as "pen strokes*'. The same input device, or another input device such as a keyboard, 
is useful for allowing an individual to create a memo data file corresponding to the 
memo relating to the document being executed. 
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Compmer software useful in systems of the present invention includes 
encryption software for encrypting data streams and color encoding data streams. 
Additional software, such as word processing programs, graphics programs, and the 
like may also be useful, for example, to aliow an individual to enter a memo relating 
to the transaction, and for viewing the digital graphic signature. 

The present invention also provides a method for producing a digital graphic 
signature corresponding to a document executed by an individual, the method 
comprising: 

forming an abstract of the document; 

obtaining the individual's signature; 

producing a document abstract data stream from the abstract; 
producing a signature data stream from the signature; and 
merging the document abstract data stream and the signature data stream into a 
digital graphic signature. 

The method may further comprise: 

obtaining memo data from the individual; 

producing a document memo data stream: and 

merging the document abstract data stream, the document memo data stream 
and the signature data stream into a digital graphic signature. 

In an alternative embodiment, the present urvention provides a method for 
producing a digital graphic signature corresponding to a document executed by an 
individual, the document method comprising: 

selecting details relating to the document; 

farming an abstract of the document; 
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obtaining the indi vidua]* s signature; 
producing a document delate data stream from the details: 
producing a document abstract data stream from the abstract; 
producing a signature data stream from the signature: and 
merging the document details data stream; the document abstract data scream 
and the signature data stream into a digital graphic signature. 
This method may further comprise: 

obtaining memo data from the individual: 
producing a document memo data stream; and 

merging the document details data stream; the document abstract daia stream, 
the document memo data stream and the signature data stream into a digital graphic 
signature. 

The data streams may be obtained and merged utilizing the techniques 
described above and in greater detail below. In addition, the data streams may be 
15 encrypted. 

In a further aspect, the present invention provides a method and means for 
providing a private communication between two parties, for example two parties to a 
transaction. The present invention provides a functionality referred to herein as a 
"digital graphic signet" or a "digigraphic signer. The digital graphic signet may 
provide additional functionality to the digital graphic signatures of the present 
mvention discussed herein. As will be understood by those of ordinary skill in the an, 
the digital graphic signet may also be utilized independently. 

As discussed herein., the digital graphic signature, systems and methods of the 
present invention provide increased functionality in comparison with digital 
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signatures and digital certificates alone. They address the consumer perceptual need 
to feel comfortable with signing a digital document and to be able to recognize a 
digital document they have signed, while having assurances that their signature was 
not forged, and it was not copied from another document. 

The signatures, systems and methods of the present invention add a human 
factor to conventional cytography that makes it recognizable and useful, for example 
by allowing a memo that assists the signatory in remembering the transaction. 
Additional benefits are that digital graphic signatures according to the present 
invention are generally smaller man conventional digital certificates, and therefore 
may be more desirable far storage purposes and to reduce network traffic loads. Thev 
are unique in the digital signature world in that their content may include representing 
a recognizable graphic of a handwritten signature while also containing digital 
signature information^ using the most appropriate prevailing crypto graphic techniques. 



As discussed herein, a digital graphic signature of the present invention may 
utilize a technique similar to steganography to encode a signatory's memo in the green 
color bytes, and ihe document's abstract in the blue color bytes, into a graphic 
representation of their hand written signature. 

The technique is not necessarily technically steganography as it is not strictly 
necessary to hide the feet that there arc messages present and encoded into the 
graphic. Therefore, Digi Graphic signatures do not attempt to hide the content of a 
communication between two or more parties. The memo is intended only for the 
signatory's use, and uses a secret key known only to the signatory. Atiy third party 
with the signatory's public key can verify the signature. Its purpose is for the 
authentication of the signatory, and to ensure non-repudiable transactions, not for 
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cncryption of private communications. It should be understood, however, that it is 
possible to encrypt a digital graphic signature of the present invention and such 
embodiments fall within the scope of chc present invention. An advantage of 
embodiments of the present invention is that further encryption may not be necessarv, 



The terminology digital graphic "signet" is borrowed from the ancient notion 
of a signet ring, which was used to seal a private communication between two parties. 
The analogy breaks down quickly, however, for in the ancient world, a broken seal 
indicated that the privacy had been compromised. It could not prevent the privacy 
from being compromised. According to the present invention a digital graphic signet 
is an embodiment of a digital graphic signature of the present invention that further 
includes a confidential communication between two parties. The digital graphic 
signet utilizes .a color value, for example the red color value in a RGB color scheme 
for the encoding and transmitting of a confidential communication. Further details are 
set forth below. 

A digital graphic signet of the present invention may also be utilized in a 
method of the present invention by encoding a confidential communication in a data 



stream. 



The digital graphic signature, digital graphic signet, systems and methods of 
the present invention may be advantageously utilized in electronic transactions, 
including transactions over the internet and network systems. The digital graphic 
signature system of the present invention may also be advantageously utilized in 
conjunction with information banking and virtual wallets such as those described in 
US patent application serial number 09/1 90,993 filed November 12 T 199S, entitled 
"Virtual Wallet System and US patent application serial number 09/190,727 filed 
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November 12 1993, entitled "Information Banking" and related technologies 
described in US patent application serial number 09/###,###, filed April ##, 1 999, 
entitled "System and Method Cor Securely Storing Electronic Data"; and US patent 
application serial number W.WiMjffl m filed April ##, ] 999, entitled "System and 
Method for Controlling Transmission of Stored Information to Internet Websites". 
The disclosure of each of these applications is hereby incorporated herein by- 
reference. 

The advantages of the digital graphic signature system and method of the 
present invention include the following. 

An individual may visually recognize their own signature. 

In previous alternatives, a graphic could be included with the document of the 
individual's signature. However, traditional graphics are easily copied and therefore 
relatively simple to forge. Additionally, there is nothing inherent about a traditional 
graphic that securely associates the graphic with a document being executed. In 
contrast, the digital graphic signature created utilizing the present invention is 
relatively difficult to forge and associated with the document being executed. 

An additional advantage is that the digital graphic signature of the present 
invention may be verified. To verity that the individual was indeed the person who 
executed the document, the known, public key could be utilized to decrypt the abstract 
portion of the signature. According to the present invention, this abstract is encoded 
into the graphic signature. The abstract should match exactly the document abstract 
that is not encrypted in the document. This demonstrates that the document was 
signed by the consumer (because they were the only person in possession of the 
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private key that produced the signature) and that the disnature is associated to a 
specific document due to the abstracts matching. 
■ - - . - In addition, the individual may use their secret key to read the memo encoded 
into the graphic signature. Insofar as the memo is not in the document, and cannot be 
5 decrypted by anyone else, unlike the abstract, the memo provides the indi vidual with 

an additional assurance that the document was not forged The memo may also assist 
the individual in remembering the document. 

An advantage of a digital graphic signet embodiment of the present invention 
is that a digital graphic signature may include a confidential communication between 
10 two parties. 

Further details and advantages of the present invention will become apparent 
Jiom the following description and the appended figures. 

Brief Description of the Drawings: 
15 Figure 1 depicts an embodiment of a digital graphic signature of the present 

invention- 
Figure 2 is a schematic representation of an embodiment of a digital graphic 
signature system of the present invention. 

Figure 3 is a flowchart of a digital graphic signing dialog function of a digital 
!0 graphic signature system of the present invention. 

Figure 4 is a sample screenshot of a document abstract before signing in a 
digital graphic signature system of the present invention. 

Figure 5 is a sample screenshot of a document body in a digital graphic 
signature system of the present invention. ~ T 



(34) &M2 O 0 0-3 60 4 

- 15- 

Figure 6 is a sample scrcctishot of a signature area before signing in a digital 
graphic signature system of the present invention. 

Figure 7 is a sample screenshot of a signature area post signing in a digital 
graphic signature system of the present invention. 
5 Figure 8 is a flowchart of a signatory verification function of a digital graphic 

signature system of the present invention. 

Figure 9 is a sample screenshot of a signature area pre-verification in a digital 
graphic signature system of the present invention. 

Figure 10 is a sample screenshot of a signature area post verification in a 
io digital graphic signature system of the present invention. 

Figure 1 1 is a flowchart of a public signatory verification function of a digital 
graphic signature system of the present invention. 

Figure 1 2 is a schematic representation of an embodiment of a digital graphic 
signature system including a digital graphic signet of the present invention. 

15 

Detailed Description of the Invention: 

The feature* and advantages of the digital graphic signature systems and 
method of the present invention are explained in the foi lowing paragraphs with 
refereuce to the Figures. 
20 Figure 1 depicts a possible embodi-nent of an individual's, "John Doe", digital 

graphic signature according to the present invention. As shown in Figure 1 . a digital 
graphic signature of the present invention has a visual appearance, 2, similar to an 
individual's written signature. As shown in the cut-away view, the visual 
representation is formed by iridividual points in a plurality of different colors. For 
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example, the visual representation may be formed by green points 4, blue points S, 
and red points 6. The relative number and position of the points of each color will be 
* unique for each transaction and based on the relative amounts and kind of document 
data and signature data that w color coded to produce the digital graphic signature. Tn 
5 general, however, the overall visual representation will be similar to an individual's 

written signature to simplify identification. 

A simple embodiment of a DigiGraphic signature includes a graphical user 
interface (GUI or simpiy UI) that allows a user to sec: 
1) an abstract of the document to be signed; 
ii> 2) the body or detail of the document to be signed; 

3) a signature pad area to graphically sign their name 

4) a personal memo area* 

The abstract may comprise a digest of what a consumer is actually agreeing to 
by signing the document. The abstract is preferably in plain (non-legal) terms, and 
15 reduced to a text representation (devoid or graphics etc.). In effect, the abstract is 
actually what is being signed. The abstract may additionally include other relevant 
items including for example the date and the names of the parties to the agreement. 

Once a consumer has read the document and has made a decision to sign, they 
move to the signarure area and graphically sign dieir name. Additionally, the 
20 consumer may be encouraged to enter a memo in the personal memo area to 

remember the transaction they are executing, 

The pen strokes utilized to sign the document, and the memo, are captured via 
a computer system, hardware and software. In addition, the computer system will 
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encode the text of the abstract and the memo into the graphic signature. A. preferred 
technique is similar to steganography. 

First the two message steams are encrypted using mooem' cryptography. The " 
abstract may be encrypted with the consumer's private key using modem public key 
cryptographic techniques. The memo text may be encrypted using a symmetric key 
known only to the consumer. 

The two encrypted streams are than used as color values in standard red, green, 
blue {ROB) coLor encoding. For example, each byte of? the abstract stream would be 
used for the blue values, which the memo stream byte values are sued for the green 
values. A non changing red value would be used to complete the color description, 

The graphical signature is defined as a series of ink strokes using "Color- 
Points", a point (relative x and y coordinates with respect to a defined signature area), 
arid a color value. The capture ink strokes are initially captured in a single color. 
During the encoding process, the color values arc replaced with the encoded 
cryptotext values. The point positions are retained, of course, to preserve the 
graphical appearance of the signature. 

Differences in the length (byte count) of the graphical signature strokes and 
the abstract and memo streams are handled by bidirectional padding. If the graphical 
signature is longer than either of the two messages, zero values are used for the blue 
and green portions and only the non zero, non changing red value is used. In this way 
The graphic appearance of the signature is preserved, even when the messages end. If 
one of the messages is longer than the graphical signature, zero point value* are 
assigned to Color-points, while the colors are still used to encode the rest of the 
rocssage(s). The interface is designed not to attempt to draw strokes that have no 
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positional value, but the non-drawn portion of the signature still preserves the 
messages. 

The graphical representation of the users signatures has been merged with a- 
digital signature into a single object This merged object has several advantages, 
5 including the following. 

Consumers can visually recognize their own signatures. In previous 
alternatives, a graphic might be included with the document of the consumer's 
signature. However, normal graphics are easily copied, and therefore forged. 
Additionally, there is little inherent about a conventional graphic thai securely 
10 associates it with a document. 

To verify that the consumer was indeed thfe person who signed the document, 
the a public key of the consumer can be utilized to decrypt Ihe abstract portion of the 
signature. The digitally signed abstract is encoded into ihe graphic signature. 
Additionally the abstract should match exactly the document abstract that is "in the 
15 clear" or not encrypted in the document. This matching demonstrates that the 

signature 1) was signed by the consumer (because they were the only person in 
possession of the private key that made the signature) and 2) that the signature is 
associated with a particular document due to the abstracts matching. 

In addition, a consumer may use their secret key to read the memo encoded 
20 into the graphic signature. Since the memo is not in the document and cannot be 

decrypted by others, unlike the abstract, the memo is an additional assurance to the 
consumer that the document was not forged and also helps them remember the 
transaction. 
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Figure 2 provides a schematic representation of a process for producing digital 
graphic (DigiGraphic) signatures. As shown in Figure 2, an embodiment of a 
DigiGraphic signature process according to the present invention includes a document 
abstract, 102 which is encrypted using a private key 104, in an asymmetric encryption 
engine 103. The process may further include a secret memo 106 which is encrypted 
using a secret symmetric key I OS in a symmetric encryption engirt 107. The 
encrypied abstract and/or encrypted memo may then be encoded with graphic 
signature ink strokes (an ordered collection of Color-Points), 1 10 produced by a 
person's signature on a signature pad. 
1° 1*he two encrypted streams are used as color vaLues in a standard RGB color 

encoding as described above. In Figure 2 the encrypted abstract bytes 1 1 1 
correspond to blue and the encrypted memo bytes 1 13 correspond to green. The 
graphic signature is defined as a series of ink strokes using color points 1 12, in the 
manner described above. The resulting object comprises a merger of the person's 
15 signature with a digital signature into a single object 114. 

Figure 3 depicts a schematic flowchart of the DigiGraphic signing dialog. The 
message sends illustrated in the flowchart would be implemented in software and 
respond to input from a person using the DigiGraphic signing feature. As shown in 
Figure 3, an initial step, or message send, is to prepare a digital document with 
20 abstract and body 122. In this step the document originating software forwards, or 

inputs, 124, the body of a document, and an abstract, to the DigiGraphic software. 
The document is then read by the DigiGraphic software Which generates a document 
abstract and a- document body, 126. A sample document abstract is depicted Ln Figure 
4 for Ted Smythc, and a sample document body is depicted in Figure 5. 
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As shown in Figure 4, a document abstract 200, may include details 202 
relating to the document being executed in a Windows® display 204 which includes 
- tabs 22 \ C Abstract"), 222 ("Body") and 223 rSignature"). Under the" Abstract" tab. 
a document abstract 200 may include factual details relating to the transaction, 
including, but not limited to the details shown in Figure 4: 

Date 03,73/1995 

Invoice 352864 

* 

Merchant Radioshack 01-3516 

SoJd To Ted Smythe 

Credit Card Type Visa 

Account 432 1 -2345-6789-345 6 

expires 04/99 

Transaction £ 1485 

Authorization 023 5 9S 

Note The card issuer may apply the total amount shown 

Terms Sales & returns are subject to terms & conditions agreed 



Thank You Thank you for shopping at Radio Shack ... 

Amount Due 27.51 
20 Figure 5 depicts a sample document body 2 1 0 for the sample transaction, the 

abstract of which is shown in Figure 4. As shown in Figure 5, a document body may 
include text details 212 of the document body of the document being executed in a 
Windows® display 214 which includes tabs 221 ("Abstract"), 222 C'Body") and 223 
("Signature"). The document body 212 may be displayed under the "Body" tab. 
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Refemng back to Figure 3, the person signing the document would review, 
128, the document abstract and body and then prompted to enter a memo which will 
help them remember the document, followed by their signature 130. Figure 6 depicts 
a possible embodiment of the user interface which prompts for a memo and signature. 

As shown in Figure 6, a signature user interface 220 may be executed in a 
Windows© display 224 which includes tabs 221 ("Abstract"), 222 ("Body") and 223 
("Signature"). Under the "Signature" tab, a signature user interface 220 may include a 
Memo area, 226, a graphic signature area 22$ and an memo entry area, 230 where an 
individual may enter a personal memo relating to the document being executed. The 
memo entry area 230 may initially include a lext prompt, prompting a user to enter a 
personal memo. The interface 220 may further include "buttons" 251 ("Sign"), 252 
("Verify'') and 253 ("Submit") which are Linked to implementing routines to enable a 
user to sign, verify and submit their signature. 

Post signing, the private memo entered by the user, and the document abstract 
are returned to the digigrapliic signature 132 encoded into the user^s signature. Figure 
7 depicts a possible embodiment of an encoded graphic signature, 140 for user "Ted 
Smythe'*. The user is then prompted, for example by a text prompt in window 230, to 
submit the encoded graphic signature to the document originator to "sign" the 
document and complete the transaction between the user and the document originator. 
As shown in Figure 3, 134 , the signed document and digital graphic signature may 
optionally be delivered to a digital document archive or a notary service for verifying 
the digital signature. The notary service would virilize the signer's public key to verify 
that the signature has not been forged. 
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A digital graphic signature system of the present invention may be 
advantageously utilized in u virtual wallet system, SX ich as the system described in 
VS. patent application serial number 09/190,993 filed November 12, 199S.the 
disclosure of which is hereby incorporated herein by reference. 
3 In a. virtual wallet the wallet owner's signature may be advantageous lv 

attached to the invoice or receipt in a format that can be recognized fay the owner. 
The format of the final signed docuioent of the present invention goes beyond a 
typical digital signature by enabling the digital signature to be humanly recognizable. 
The format of the final signed document enables the owner to visibly distinguish a 
io signature as their own, associate the signature with a particular document, and verify 

that the signature and document are not forged or copied. The signature comprises a 
DigiGraphic signature of the present invention and comprises digital signatures and 
graphics that the wallet owner recognizes as their own. The feature of providing a 
recognizable and distinguishable digital signature in an electronic document is unique, 
15 and akin to the wallet owner recognizing their own hand-written signature in a paper 

document. This feature helps the wallet owner remember particular transactions and 
verify their own signature. Further details relating to digital graphic signatures are set 
forth above. 

Notwithstanding the format, it is recommended for a document that needs to 
20 be signed that the document comprises at least an abstract and a body. The abstraci, 

also known as the abstract in the clear, comprises a digest of what the consumer is 
agreeing to when they sign the document, presented in plain, non-graphical text. The 
abstract may be information concerning the payment, the delivery or the terms and 
conditions of the transaction, or other similar informauon- For example, payment 
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information in the abstract may include the date, the parties involved, the general 
nature of the transaction, and the payment amount. The body comprises the full 

amount of formatted information that is normally referred to as the document. The 

body, therefore, comprises all of the details associated with the transaction. Once the 
5 document is signed, it has at least three components: the abstract, the body and the 

signature. There may, however, be other components, such as a general terms and 
conditions section, shipping inforrnation, etc. So, by sending this formatted 
infoirriation to an appropriately enabled browser, for example, an invoice can be 
rendered for the wallet owner. 

10 In operation, referring to Figure 3, the signature requester, such as a restaurant, 

wants the wallet owner to sign a document, such as a receipt The requester initiates 
the dialogue and sends a document and an abstract. A feature of the present invention 
specially formats the document and the abstract and designates it as a signature 
document for recognition by the software. The wallet server sends the signature 

15 document to the wallet interface when it comes on line, thereby supporting both 

synchronous and asynchronous dialogs. The wallet .interface displays the signature 
document and abstract to the wallet owner for signing. The owner then picks one of 
their signature key mcknaraes, or in. other words the persona thai they are signing 
with, and they graphically sign the document. The chip device encrypts the abstract 

20 -with a private key and the memo with a secret key. This allows anyone with public 

key matching the private key to access the document, while the memo is kept 
confidential to the owner and anyone else who is given access to the secret key, which 
' may or may not be the public key. The signed document now comprises the body, 
abstract and the DigiGraphic Signature (DS). The D$ includes the digital signature by 
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virtue of the abstract being encrypted with the private key. 

Further, the chip device passes the signed document and the associated index 
back to the wallet server*. The chip device is tasked with remembering the index' so ' " * 
that the wallet owner does not have to worry about it. The wallet owner can even be 
3 off-line. The wallet server archives the signed document and forwards the index, the 

document identification, and the signature guarantor URL to the signature requester, 
who stores this information. Finally, the requester acknowledges the receipt of the 
information. Thus, this feature of the present invention advantageously manages 
multiple signature keys and their associated indexes. 
10 When the preferred DigiUraphic signature is used to sign a document, as 

described herein, the Digi Graphic signature object knows how to render a graphic of 
the signature when requested to do so. The DigiGraphic signature also contains the 
digital signature. The DigiGraphic signature encapsulates the behavior for third 
parties to perform signature verifications and for the document signer to verify their 
!5 own signature and the validity of its association to the document. Further, as one 

skilled tn the art will recognize from the description below, the preferred DigLGraphic 
signature advantageously serves to authenticate and authorize a document, elimiriating 
the need for bulky digital certificates. 

Figure 8 is a flowchart illustrating a possible verification document for use 
20 when the person who signed a document (the signatory) is not sure that they actually 

signed the document, or does not remember the transaction and desires to view the 
encrypted memo. Upoa retrieval of a document, the signatory may view the 
signature, 140 oa the document. A possible embodiment is shown in Figure 9 in 
interface 220. The user may be prompted, for example in window 230 in Figure 9, to 
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request signature verification 150 (Figure &). Upon requesting verification the 
potential signatory's (verifier's) secret key 152 is utilized to decodfr the memo 
• accompanying the signature 153. In order to use the secret key the user's w ould be 
prompted to enter a password. The potential signatory's public key, 1 54 is utilized to 
5 decode the signature and the document abstract 1 55. The decoded memo and the 

document abstract are then compared to the actual memo and document abstract 157 
and if they match arc displayed to the signatory, for example in windows 228 and 230 
in Figure 9 to allow the signatory to verify that they have signed the document, 159. 
A possible embodiment is shown in Figure TO. 
10 As shown in Figure 10, a signature 140 ("Ted Smythe ,? ) may be displaj'ed in 

window 228, a personal memo displayed in window 226 and a docunienL abstract in 
window 230. In Figure 1 0, the document abstract corresponds to the abstract 
depicted in Figure 4. 

If the memo, abstract and/ or signature are not decodabIe ? or do not match the 
15 documents, a warning message may be displayed to the user and tJic signatc-ry may 

notify the document originator of a potential Forgery 163 . 

Another feature of the present invention, referring to Figure 8. advantageously 
further addresses the consumer feeling for the need to recognize their own digital 
signature. When a wallet owner wants to verify the authenticity of their signature on a 
20 signed document, then the local signature verification feature is utilized. 

Alternatively or additionally! the system may automatically verify the signature every 
time a document is opened, and only alert the wallet owner whenever there is a 
mismatch. For example, the warning may say something like "The signature does not 
match the abstract. " 
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In the present case, the wallet owner retrieves a document and abstract from 
the document archive, which may reside on the owner's personal computer, in the 
- - - wallet server, ar in other similar device?. -As-discussed above, preferably the 

document is signed utilizing the DigiGraphic Signature. The wallet owner wants to 
5 make sure the signature is not forged, for example, and requests verification. The 

wallet interface sends a public key request to the secure chip device, which returns the 
key that was previously stored in association with the document. The interface then 
uses the key to decrypt the digital portion of the signature, comprising the abstract. 
The interface compares the decrypted abstract information to that of the abstract in the 

1 0 clear, or the abstract that is not encrypted in the document. That comparison 

demonstrates that the signature was signed by the owner because they were the only 
person in possession of the private key that made the signature, and thai the signature 
is associated to that specific document due to the matching abstracts. Further, the 
graphic portion of the signature is recognizable to the owner, and ihe fact that the 

15 decrypted abstract, which was merged with graphical signature, matches the abstract 

in the clear assures the owner of it's authenticity. Thus, the wallet interface then 
returns a message to be viewed by the owner reporting the results of the verification 
check. 

The combination of the digital and graphical comparison advantageously 
20 allows the signature to be verified for that particular document. This feature is unique 

and allows for high confidence as compared to merely checking the digital signature, 
which comprises bits that may be undetectably copied. Thus, this feature verifies that 
the DigiGraphic signature is the original signature, and not just something that looks 
like the original. 
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Addirionally. this feature advantageously allows only the wallet owner to 
decode the memo, which is not stored anywhere else in the document, and which mav 
contain a reminder to the wallet owner of the transaction. 

Figure 1 1 is a flowchart of a possible public signature verification dialog for 
5 use with the digital graphic signature system of the present invention. The dialog may 

be used when someone other than the signatory, for example a merchant or notary, 
wishes to verify the signature. As set forth above, only a signatory may view the 
memo text associated with the signature. Further, although an optional comparison of 
the document and digital graphic signature held by the requesting party to that of a 
»o thiTd party notary is not included in Figure 1 1, such features may be added by similar 

steps. 

As shown in Figure 1 1, when a request for verification of a digital graphic 
signature is made by a third party requester, 1 71 the signatory's public key 154 is 
utilized to decode the document. This public key wouid have been previously 
15 supplied to the requester. The public key decrypts the document abstract 1 73. The 

decrypted abstract is compared to the actual document abstract, 1 75 and the results, or 
warnings in the case they do not match are displayed to the requester, 177. 

Referring to Figure 11, the present invention advantageously provides a 
service through electronic mail, direct login, or the world wide web for electronic 
20 signature verification. In this case the verification requester sends the signed 

document, the document ID. and the signer's index to a signature guarantor. For 
example, on the world wide web, it may look like this: 
http ://www. citibank, co m/verify si gnarure 

Signature: (insert Digi Graphic signature) 
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of Signer: (insert Index) 

Against: (insert Document ID) 

With: (insert-Abstract). • • • - ■ *- 



5 The index of the signer is unique to each signature guarantor, so they know 

who tbc signer is and what public key was used. Also, the document ID may be found 
in the wallet server, which archived at least the abstract of the document when the 
document was initially signed. Finally, the abstract is the document on which the 
verification requester is asking to have the signature verification performed. 

io The signature guarantor utilizes the index to look up the public key in the 

public key archive. The signature guai^amor uses the public key, in turn, to decrypt 
the signature that is being verified. If the signature decrypts at all, then that verifies 
that the signature is from the signer of record. By using the document ID, the 
signature guarantor looks up its copy of the abstract, and compares it with the 

13 submitted abstract to further verify that it is the correct signature on the correct 

document Then, the signature guarantor returns the results to the verification 
requester. 

This feature of the present invention advantageously utilizes the index and 
document ID to verify the signature. On the other hand, current methods require 
20 certificates that CO main very large amounts of information, such as the public key, tbc 

certifier of the certificate and the abstract. Further, because of this large amount of 
information, the signature guarantor using current methods has no active role in 
guaranteeing the process. On the other hand, the signature guarantor has a very active 
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role in the present invention. Tims, this feature of the present invention more 
efficiently and economically enables the verification of signatures. 
* As will be realized from the foregoing description, the digital graphic 

signature system of the present invention includes many advantageous features. 
5 According lo the present invention, a digital signature and a secret memo may 

advantageously be encoded into a single graphic signature. 

An additional advantage is that the graphic signature is recognizable to the 
signer of the document who also has assurances that the signature is associated with a 
particular document and was actually signed by the signer and not forged. 
10 A further advantage of the digital graphic signature system of the present 

invention is that the digital portion of the signature may be verified by a third party 
with knowledge of the public portion of the signatory^ security key. 

A still ftrther advantage of the digital graphic signature system of the present 
invention is that the memo associated with a document remains secret to the signer of 
15 the document- 

As in the description of a virtual wallet system of the present invention, the 
digital graphic signature system of the present invention may be advantageously 
utilized in conjunction with a virtual wallet system of the present invention. 

Figure 12 provides a schematic representation of a digital graphic signature 
20 system of the present invention which includes a digital graphic signet. Encrypted 

abstract byte, 1 1 1 and encrypted memo byte, 1 13 are produced as described above and 
depicted in Figure 2. The ofTpage connector "A" represents that stream entering the 
encoding process as it did before in the previous discussion. Likewise, The secret 
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memo is encoded in the same way as it was before. The off page connector "M" 
represents that stream entering the encoding process as it did before. 
' In the embodiment of a digital graphic signet of the present mvenrion depicted - 

in Figure 1 2, the red color byte value 302 is utilized for a private communication. As 
5 shown in Figure 12, a private communication, 304 may be reduced m textual 

representation and encrypted using the sender's (signatory) private key 306. The 
result of the encryption 308, is then encrypted again with the recipient's public key 
310. The result of that last operation may then be used, byte for byte, as the red color 
value in the Color Point object stream described in ihe previous discussion with 
10 reference to Figure 2 on a digital graphic signature. 

Upon receipt of the corrununication* the recipient will first use their 
private key to decrypt the first layer. Because they will be receiving a digital graphic 
signet with the document, which is distinct from a digital graphic signature, they will 
know that there is a private communication in the red color value and process ir 
15 differently than they would a digital graphic signature. Once they have the first layer 

decrypted, they will use the public key of the sender to decrypt tbe final layer. Double 
encryption and the order of encryption and decryption is advantageous for several 
reasons. 

If a single level encryption were used, if the sender used (he public key of the 
20 recipient, then only the recipient could decode the message, which is one desirable 

trait However, the recipient would not know for sure that the claimed sender was in 

fact the real sender without another digital signature- 
Suppose that instead of using the recipient's public key, the sender uses their 

private key. Then the recipient can use the sender's public key to decrypt the message 
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and will know only they could have sent die message, the other desirable trait. This 
has a problem too ? however, in that anyone else with knowledge of the sender's public 
key (which should be everyone since a public key is public) could also decrypt me 
message. 

5 The usage of double encryption according to the present invention is novel and 

unique as it leverages off the concept of digital graphic signatures. The digital 
graphic signet may be a component of a document, and therefore may be flexible in 
how it is used- 

For example, if the private communication is shoTt. the content of the 
10 communication can be fully contained in the digital graphic signet. The abstract of 

the document would be used to convey the general nature, but not the details. The 
body of the document may be empty or a copy of the abstract. 

In longer private communications, a symmetric key may be encoded in the 
digital graphic signet to be used to decode the body of the document. This is not 
15 unlike a "session key" described in conventional cryptographic literature. Another 

advantage of the digital graphic signet's flexibility is it can be used synchronously, as 
in an online session, ot asynchronously, as in an E-mail document. 

Although a digital graphic signet may be used in all transactions, it benefits 
may be found in communications other than those utilized to communicate actual 
20 online session keys, as there is already robust technology available (e.g. Diffie- 

Hellman), and that type of security is general at a lower level (transport layer vs. 
application layer) of network communications. A digital graphic signet could be used 
in addition to conventional session keys for added security. This is particularly 
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advantageous when the intent is to keep the concern encrypted, and prevent it irom 
appearing in the clear once it is received at the recipient's server. 

For example, a bank customer may wish to change their ATM PIN over the 
Internet. The document could contain an abstract that might be as general as only 
5 indicating that it is a customer instruction to the bank. Since an ATM PIN change is a 

short message, the Signet would have the necessary account number, old PIN, and 
new PIN encoded into its red color value, as described earlier. Given an appropriate 
prevailing encryption technology is used, the strength of the encryption will be robust, 
the sender will be able to be authenticated,, and only the intended recipient (the bank) 
10 will be able to see the details of the transaction. The abstract in the clear will give the 

bank processing center enough information to transport the Signet to an appropriately 
secure environment to decrypt and process the transaction without compromising the 
privacy or the security of the transaction. 

Although the invention has been described with reference to preferred 
15 embodiments and features, oilier similar embodiments and features may be utilized to 

obtain similar results. Variations and modifications of the present invention will be 
apparent to one skilled in the art and the present disclosure is intended to cover all 
such modifications and equivalents within the scope, of tire following claims. 
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Claims: 

1. A digital graphic signature for a transaction involving an individual the 
digital graphic signature having a visual representation comprising a plurality of 
points the digital graphic signature comprising: 

5 merged points of at least a first color corresponding to transaction details data 

and points of at least a second color corresponding to the individual's signature data 
the points forming a visual representation of the individual's signature. 

2. The digital graphic signature of claim 1 wherein the transaction details data 
10 comprise at least one of the following: 

an abstract of the document being executed; 

the body of the document being executed; 

excerpts from the body of the document being executed; or 

an individual's notes relating to the document being executed. 

15 

3. The digital graphic signature of claim 2 wherein the transaction details data 
comprise the abstract. 



20 



4. The digital graphic signature system of claim 3 wherein the abstract 
comprises a digest of what the individual is actually agreeing to by executing the 
document. 
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5. The digital graphic signature of claim 3 wherein the abstract comprises at 
least one of the following types of reference information: the date, the parties 
involved, or a transaction reference number. 

5 6. The digital graphic signature of claim 3 wherein the abstract ts in text. 

7. The digital graphic signature of claim 2 wherein the transaction details data 
comprise excerpts from the body of the document being executed. 

10 8. The digital graphic signature of claim 3 wherein the transaction detaUs data 

comprise excerpts from the body of the document being executed. 

9. The digital graphic signature of claim 7 wherein the excerpts arc in text 

form. 

15 

3 0. The digital graphic signature of claim 2 wherein the transaction details 
data comprise the body of the document being executed. 

11. The digital graphic signature of claim 2 wherein the transaction details 
20 data further comprise an individnal's notes. 



12. The digital graphic signature of claim 1 1 wherein the individual's notes 
comprise the purpose of the transaction, the nature of the transaction, or other details 
having significance to the individual. 
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13. The digital graphic signature of claim 3 wherein the transaction details 
data further comprises an individual's notes. ' . - ■ 

5 14. The digital graphic signature of claim 1 wherein the individual's signature 

data comprises graphical data generated from □ graphic of the individual signature. 

1 5. The digital graphic signature of claim 1 wherein the transaction details 
data and the individual's signature data are encrypted. 

10 

1 6. The digital graphic signature of claim 1 wherein the merged points are 
color encoded. 

17. The digital graphic signature of claim 13 -wherein the transaction details 

15 data 

and the individual's signature data are color encoded wherein the abstract comprises 
blue values, the individual's notes comprise green values and the individual's 
signature data comprise ted values. 

20 13. The digital graphic signature of claim I wherein the visual representation 

is capable of being displayed on a video display tenninal. 

19. A digital graphic signature of claim 1 further comprising a digital graphic 
signet encoded in at leas* one of the plurality of colors. 
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20. A digital graphic signature system comprising: 
the digital graphic signature of claim 1; 
an input apparatus for the transaction details data; 
5 an input apparatus for the signature daia; and 

a video display terminal. 



21. A method for producing a digital graphic signature corresponding to a 
document executed by an individual, the method comprising; 

10 forming an abstract of the document; 

obtaining the individual's signature; 

producing a document abstract data stream from the abstract; 
producing a signature data stream from the signature; and 
merging the document abstract data stream and the signature data stream into a 
15 digital graphic signature. 

22. The method of claim 21 further comprising: 
obtaining memo data from the individual: 
producing a document memo data stream: and 

20 merging the document abstract data stream, the document memo data stream 

and the signature data stream into a digital graphic signature. 



23. A method for producing a digital graphic signature corresponding to a 
document executed by an individual, the document method comprising; 
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selecting details relating to the documeat; 
forming an abstract of the document; 
obtaining the individual's signature; 
producing a document details data stream from the details; 
5 producing a document abstract data stream from the abstract; 

producing a signature data stream from the signature; and 
merging the document details data stream; the document abstract data stream 
and the signature data stream into a digital graphic signature. 



10 24. The method of claim 23 further comprising: 

obtaining memo data from the individual: 
producing a document memo data stream: and 

merging the document details data stream; the document abstract data stream, 
the document memo data stream and the signature data stream into a digital graphic 
15 signature. 
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Abstract: 

The present invention relates to a digital graphic signature system and methods 
for use in electronic commerce. The system comprises a document portion, including 
5 information relating to the document being executed, and a signature portion. The 

document portion and the signature portion may be encrypted and merged into a 
single object readily identifiable to an individual. The Terminology "digital graphic 
signature" or "digigraphic signature ,, is utilized herein to describe the merged object. 
The digital graphic signature system of the present invention may be 
10 advantageously utilized in electronic transactions, including transactions over the 

internet and network systems. The digital, graphic signature system of the present 
invention may also be advantageously utilized iu conjunction with information 
banking and virtual wallets. 

Also disclosed is a digital graphic signet for transmitting a private 
15 communication. 



